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Abstract of EP1400922 

A method of inspecting a defect on a surface of a printed matter includes a step of applying a gray 
scale erosion filter to a non-defect surface of a printed matter to prepare a gray scale erosion filter 
applied image and then adding a predetermined density value to the gray scale erosion filter applied 
image, thereby preparing a reference image, a step of subtracting a captured image of the surface of 
the printed matter to be inspected from the reference image, thereby preparing a differential image, 
and a step of applying a density compensation process to the differential image to prepare a density 
compensated image, then applying an edge detection filter to the density compensated image to 
prepare an edge detection filter applied image and then converting the edge detection filter applied 
image into binary data according to a predetermined threshold value. 
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(57) A method of inspecting a defect on a surface of 
a printed matter includes a step of applying a gray scale 
erosion filter to a non-defect surface of a printed matter 
to prepare a gray scale erosion filter applied image and 
then adding a predetermined density value to the gray 
scale erosion filter applied image, thereby preparing a 
reference image, a step of subtracting a captured image 
of the surface of the printed matter to be inspected from 



the reference image, thereby preparing a differential im- 
age, and a step of applying a density compensation 
process to the differential image to prepare a density 
compensated image, then applying an edge detection 
filter to the density compensated image to prepare an 
edge detection filter applied image and then converting 
the edge detection filter applied image into binary data 
according to a predetermined threshold value. 
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Description 

[0001] The present invention relates to an inspection 
method and apparatus that are capable of detecting de- 
fects such as stains or spots on the surface of a printed s 
matter, printed character deficiencies and the like, and 
more particularly- to an inspection method and appara- 
tus that is capable of detecting these defects of printed 
matters with high accuracy by reducing influences of po- 
sitional displacement of a printed matter, warped printed 10 
matter and any other printed matters conveyed under 
various conditions on a conveyor line or other conveyor 
means particularly during they are conveyed independ- 
ently of each other in a sequential order. The aforesaid 
defects also represent any foreign matters such as 
dusts mixed into the inside of a printed matter, which are 
visible through the surface of the printed matter when 
the printed matter is made of a transparent and/or 
opaque material with printed information thereon (e.g., 
a paper packet for a dose of medicine). 
[0002] A known method to determine the presence of 
a defect of a printed matter involves capturing as an in- 
spection object an image of such as a continuously-con- 
veyed elongated printed matter to produce an inspec- 
tion image (a captured image of the surface of the print- 
ed matter), and comparing the inspection image to a ref- 
erence image (a captured image of the surface of a non- 
defect printed matter) on a pixel-by-pixel basis, so that 
a defect is recognized as "present" at a pixel where the 
density difference is larger than a predetermined value. 
[0003] In the above prior method, where positional 
displacement exists between the compared reference 
image and inspection image, accurate detection of the 
defect is unlikely to be made. In order to address this 
problem, various methods for accurate positioning both 
images were proposed. 

[0004] Another approach to address the above prob- 
lem hitherto proposed is to reduce the possibility of mis- 
judgment due to error in image positioning by masking 
a specific region of a printed matter such as an edge of 
a printed image at which a sharp increase or decease 
in density difference occurs if the positional displace- 
ment has been caused, so that such a region is removed 
from the inspection image. 

[0005] Still another approach to address the above 
problem hitherto proposed such as in Japanese Patent 
Application Laid-open No. Hei-7-1 86375 is to detect a 
defect while avoiding the occurrence of a region, which 
might be removed from the inspection image by the 
masking process, by applying a gray scale dilation filter 
or a gray scale erosion filter to any one of the reference 
and inspection images, generating a differential image 
and converting the same into binary data. 
[0006] However, the inspection methods as described 
above each are intended to inspect printed matters suc- 
cessively conveyed under a secured condition. There- 
fore, these methods may not accurately inspect printed 
matters conveyed under unstabilized imaging condition 



(e.g., lighting condition), such as those conveyed inde- 
pendently of each other in a sequential order under var- 
ious conditions, which are likely to be relatively largely 
displaced from the correct or intended position within the 
imaging field of view, or warped. Hence, the convention- 
al methods have a problem that a minor defect of such 
printed matters may not be detected only by converting 
a differential image into binary data. 
[0007] Particularly, where printed matters to be in- 
spected are provided by punching or die cutting a sub- 
strate on which printing has been applied, punching er- 
rors must be taken into account. That is, such punching 
error makes it unlikely to punch or die cut the matter at 
a constant position in every operation, with the result 
that printed matters produced by punching or die cutting 
may have different contours and cause positional dis- 
placement on the conveyor. Thus, the positional dis- 
placement of the contour of the inspection image rela- 
tive to the contour of the reference image already exists 
before the inspection, thus posing a problem of neces- 
sarily causing a region, which may not be inspected on 
the basis of the differential image. 
[0008] The present invention has been conceived to 
address the above problems. It is an object of the 
present invention to provide an inspection method and 
apparatus that are capable of achieving inspection of a 
defect with high accuracy by reducing influences of 
printed matters, which have been displaced from the 
correct or intended position during the conveyance, or 
warped printed matters. 

[0009] It is another object of the present invention to 
provide an inspection method and apparatus that are 
capable of achieving inspection of a defect with high ac- 
curacy by reducing influences of printed matters, which 
have contours displaced from each other, such as those 
produced by punching or die cutting a substrate with 
printing applied thereon. 

[0010] To achieve the above objects, there is provided 
a method of inspecting a defect on a surface of a printed 
matter, which includes: a step of applying a gray scale 
erosion filter to a non-defect surface of a printed matter 
to prepare a gray scale erosion filter applied image and 
then adding a predetermined density value to the gray 
scale erosion filter applied image, thereby preparing a 
reference image; a step of subtracting a captured image 
of the surface of the printed matter to be inspected from 
the reference image, thereby preparing a differential im- 
age; and a step of applying a density compensation 
process to the differential image to prepare a density 
compensated image, then applying an edge detection 
filter to the density compensated image to prepare an 
edge detection filter applied image and then converting 
the edge detection filter applied image into binary data 
according to a predetermined threshold value. 
[001 1 ] According to the above method, the gray scale 
erosion filter is applied to the non-defect surface of a 
printed matter and adding a predetermined density val- 
ue to the gray scale erosion filter applied image. Herein, 
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by the gray scale erosion finer is meant a process that 
designates a minimum density value in a peripheral re- 
gion (e.g. , a 3 by 3 pixel region and a 5 by 5 pixel region) 
of a target pixel as a new density value of the target pixel. 
This application of the gray scale erosion filter allows a s 
dark region (a region having a lower density value) of 
the captured image to have a large size, while a light 
region (a region having a higher density value) to have 
a small size, thus enabling the acceptance of the posi- 
tional displacement by an amount corresponding to this 
changing. Then, a predetermined density value is added 
to the gray scale erosion filter applied image so that the 
reference image has in its entire region a high density 
value except for an edge region where change in size 
has been caused. Thus, it is possible to reduce the in- 
fluence of a printed matter having uneven density due 
to its positional displacement or warping to a differential 
image. 

[0012] Then, a captured image of the surface of the 
printed matter to be inspected is subtracted from the ref- 
erence image, thereby preparing a differential image. 
Accordingly, a defect darker than the non-defect surface 
(hereinafter referred to a dark defect) of the thus pre- 
pared differential image has a positive property (a prop- 
erty enabling a density value higher than peripheral pix- 
els), while a defect lighter than the non-defect surface 
(hereinafter referred to a light defect) has a negative 
property (a property enabling a density value lower than 
peripheral pixels). 

[0013] Then, the density compensation process (a 
process to compensate a region having a negative prop- 
erty with the density value of a peripheral region) is ap- 
plied to the differentia! image, so that only a region hav- 
ing the positive property (dark defect) becomes promi- 
nent. Then, the edge detection filter such as a Sobel fil- 
ter is applied to the density compensated image. Thus, 
it is possible to reduce the influence of a printed matter 
having uneven density (shading) due to its positional 
displacement or warping, and hence achieve the con- 
version process into binary data under a secured con- 
dition. 

[001 4] With the above described method, it is possible 
to detect defects of the printed matters with high accu- 
racy by reducing influences of positional displacement 
of a printed matter during the conveyance, warped print- 
ed matter and any other printed matters conveyed under 
various conditions. By the defects on a surface of a print- 
ed matter is meant not only stains or spots, printed char- 
acter deficiencies and any other defects actually caused 
on the surface of the printed matter, but also any foreign 
matters such as dusts mixed into the inside of a printed 
matter, which are visible through the surface of the print- 
ed matter when the printed matter is made of a trans- 
parent and/or opaque material with printed information 
thereon (e.g., a paper packet for a dose of medicine). 
[0015] Likewise, in order to detect a light defect, there 
is provided a method of inspecting a defect on a surface 
of a printed matter, which comprises: a step of applying 



a gray scale dilation filter to a captured image of a non- 
defect surface of a printed matter to prepare a gray scale 
dilation filter applied image and then subtracting a pre- 
determined density value from the gray scale dilation fil- 
ter applied image, thereby preparing a reference image; 
a step of subtracting the reference image from a cap- 
tured image of the surface of the printed matter to be 
inspected, thereby preparing a differential image; and a 
step of applying a density compensation process to the 
differential image to prepare a density compensated im- 
age, then applying an edge detection filter to the density 
compensated image to prepare an edge detection filter 
applied image and then converting the edge detection 
filter applied image into binary data according to a pre- 
determined threshold value. Herein, by the gray scale 
dilation filter is meant a process that designates a max- 
imum density value in a peripheral region (e.g., a 3 by 
3 pixel region and a 5 by 5 pixel region) of a target pixel 
as a new density value of the target pixel. 
[0016] Preferably, the density compensation process 
is achieved by applying a gray scale dilation filter and a 
grayscale erosion filter, respectively. This application. of 
the gray scale dilation filter compensates the density of 
a region having a negative property, which causes a de- 
fect having a positive property to have a large size. 
The gray scale erosion filter is applied so as to return 
the size of the enlarged defect to an original size. 
[0017] Alternatively, the density compensation proc- 
ess may be achieved by applying a density conversion 
process. As this density conversion process, a density 
conversion process, which involves converting a region 
having a density value lower than the added (subtract- 
ed) density value into the added (subtracted) density 
vaiue, while keeping a region having a density higher 
than the added (subtracted) density value intact, is ap- 
plicable. 

[0018] In order to achieve inspection of a defect with 
high accuracy by reducing influences of printed matters, 
which have contours displaced from each other, such 
as those produced by punching or die cutting a substrate 
with printing applied thereon, the reference image is pre- 
pared on the basis of a captured image of a non-defect 
surface of the matter in a state prior to be punched or 
die cut. 

[0019] According to the above method, the reference 
image is prepared on the basis of the captured image 
of a non-defect surface of the matter in a state prior to 
be punched or die cut, so that even if the contour of the 
printed matter to be inspected is itself displaced, it can 
be compared with the reference image. As a result, it is 
possible to detect a defect with high accuracy. 
[0020] In order to achieve inspection of a defect with 
high accuracy by reducing influences of printed matters, 
which have been displaced from the correct or intended 
position during the conveyance, or warped printed mat- 
ters, there is also provided an apparatus for inspecting 
a defect on a surface of a printed matter including: an 
imaging device for capturing a surface of a printed mat- 
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ter to prepare a captured image; and an image process- 
ing device for applying image processing to the captu red 
■image of the surface of the printed matter; wherein the 
image processing device includes: a means of applying 
a gray scaie erosion fitter to a captured image of a non- 
defect surface of a printed matter to prepare a gray scale 
erosion filter applied image; a means of preparing a ref- 
erence image by adding a predetermined density value 
to the gray scaie erosion filter applied image; a means 
of preparing a differential image by subtracting a cap- 
tured image of a surface of a printed matter to be in- 
spected from the reference image; a means of applying 
a density compensation process to the differential im- 
age to prepare a density compensated image; a means 
of applying an edge detection filter to the density com- 
pensated image to prepare an edge detection filter ap- 
plied image; and a means of converting the edge detec- 
tion filter applied image into binary data according to a 
predetermined threshold value. 
[0021] According to still another aspect of the present 
invention, there is provided an apparatus for inspecting 
a defect on a surface of a printed matter comprising: an 
imaging device for capturing a surface of a printed mat- 
ter to prepare a captured image; and an image process- 
ing device for applying image processing to thecaptured 
image of the surface of the printed matter; wherein the 
image processing device includes: a means of applying 
a gray scale dilation filter to a captured image of a non- 
defect surface of a printed matter to prepare a grayscale 
dilation filter applied image; a means of preparing a ref- 
erence image by subtracting a predetermined density 
value from the gray scale dilation filter applied image; a 
means of preparing a differential image by subtracting 
the reference image from a captured image of a surface 
of a printed matter to be inspected; a means of applying 
a density compensation process to the differential im- 
age to prepare a density compensated image; a means 
of applying an edge detection filter to the density com- 
pensated image to prepare an edge detection filter ap- 
plied image; and a means of converting the edge detec- 
tion filter applied image into binary data according to a 
predetermined threshold value. 
[0022] FIG. 1 is a schematic structural view of an in- 
spection apparatus, which carries out the inspection 
method according to an embodiment of the present in- 
vention. 

[0023] FIG. 2 illustrates an example of an image of a 
printed matter captured by an imaging device of FIG. 1 . 
[0024] FIG. 3 illustrates an example of an image of a 
substrate captured by the imaging device of FIG. 1 . 
[0025] FIG. 4 illustrates a functional block diagram of 
an image processing device of FIG. 1. 
[0026] FIGS. 5 respectively illustrate density profiles 
of the images captured by the imaging device of FIG. 1 . 
[0027] FIGS. 6 respectively illustrate explanatory 
views for stepwisely explaining an inspection process 
for dark defects in a non-warped printed matter. 
[0028] FIG. 7 is a graph illustrating an example of a 



density conversion process. 

[0029] FIGS. 8 respectively illustrate explanatory 
views for stepwisely explaining an inspection process 
for dark defects in a warped printed matter. 
5 [0030] FIGS. 9 respectively illustrate explanatory 
views for stepwisely explaining an inspection operation 
for light defects in a warped printed matter. 
[0031] FIGS. 1 0 respectively illustrate examples of a 
Sobel filter. 

w [0032] An embodiment according to the present in- 
vention will be hereinafter described with reference to 
the accompanying drawings. 
[0033] FIG. 1 is a schematic structural view of an in- 
spection apparatus, which carries out the inspection 
is method according one embodiment of the present in- 
vention. As illustrated in FIG. 1 , ah inspection apparatus 
100 of this embodiment includes an area scan CCD 
camera 1 as an imaging device for capturing an image 
of the surface of each printed matter P transferred on a 
conveyor C, and an image processing device 2 for ap- 
plying image processing to an image of the surface of 
each printed matter P captured by the CCD camera 1 
so as to detect defects such as stains, spots or printed 
character deficiencies on the surface of the printed mat- 
ter, as well as foreign matters intruded into the inside of 
a bag-shaped printed matter made of a transparent and/ 
or opaque material. 

[0034] The inspection apparatus 1 00 of this embodi- 
ment includes lighting devices 3 for illuminating the sur- 
face of each printed matter P from the side thereof and 
an optical sensor 4 for detecting each printed matter P 
passing thereunder, so that an image output from the 
CCD camera 1 is input into the image processing device 
2 at a predetermined timing after the sensor 4 has de- 
tected each printed matter P passing thereunder. 
[0035] FIG. 2 illustrates an example of an image of 
each printed matter P captured by the CCD camera 1 . 
As illustrated in this Figure, the Imaging field of view of 
the CCD camera 1 is set to be larger than the size of the 
printed matter P, thereby enabling secured capturing of 
the image of the entire surface of the printed matter P, 
which may be displaced from the correct or intended po- 
sition during the conveyance. 
This results in capturing an image of an surface C1 of 
the conveyor 1 ,along with the image of the surface of 
the printed matter P. Accordingly, in order to securely 
extract the contour of each printed matter P, it is prefer- 
able to make the surface C1 of the conveyor C from a 
material enabling the surface C 1 to have a large contrast 
to the surface of the printed matter P or to color the 
same, as described later. In FIG. 2, the reference codes 
D1 and D2 respectively represent a light defect and a 
dark defect. 

[0036] The printed matters P in this embodiment each 
are produced by punching or die cutting a substrate on 
which printing has been applied. FIG. 3 illustrates an ex- 
ample of an image of a substrate P' captu red by the CCD 
camera 1 . As can be seen by the comparison between 
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FIGS. 2 and 3, the printed matter P is produced by 
punching out the center of the substrate P'. As described 
later, the Inspection apparatus 100 of this embodiment 
employs the captured image of a non-defective surface 
of the substrate P as a reference image, thus enabling 
highly accurate inspection with no influence of the print- 
ed matter P which has been displaced from the correct 
or intended position (or caused positioning error in 
punching). 

[0037] The image processing device 2 is made up by 
utilizing a general purpose personal computer, which in- 
cludes an A/D conversion board, an image memory, a 
control unit (not shown) made up of a CPU that controls 
their operations, as well as running a predetermined im- 
age processing program previously stored. Now, the de- 
scription will be made specifically for the operation of 
the image processing program which is run in the image 
processing device 2, with reference to FIGS. 4-9. Here- 
in, the operation is roughly categorized into a reference 
image preparation operation and an inspection-ongoing 
operation. 

Reference Image Preparation Operation 

[0038] FIG. 4 illustrates a functional block diagram of 
the image processing device 2 according to this embod- 
iment. As illustrated in this Figure, in order to prepare 
the reference image, an image (FIG. 3) of the substrate 
P' captured by the CCD camera 1 is converted into dig- 
ital signals at an A/D conversion unit 201. More specif- 
ically, the A/D conversion unit 201 performs an 8-bit A/ 
D conversion so as to allocate the values of 0-255 (den- 
sity values) to pixels, in order from a low density pixel 
to a high density pixel. FIG. 5C illustrates a density pro- 
file taken along the line B-B (FIG. 3) in the captured im- 
age of the substrate P' which has been thus A/D con- 
verted. 

[0039] Then, as illustrated in FIG. 4, a gray scale ero- 
sion filter 202 is applied to the A/D converted image by 
the control unit. Herein, by the gray scale erosion filter 
is meant a process that designates a minimum density 
value in a peripheral region (e.g., a 3 by 3 pixel region 
and a 5 by 5 pixel region) of a target pixel as a new den- 
sity value of the target pixel, in which the peripheral re- 
gion can be properly set in the parameter setting accord- 
ing to each case. The number of times at which the gray 
scale erosion filter 202 is applied can also be set in the 
parameter setting. 

[0040] Then, the image to which the gray scale ero- 
sion filter 202 has been applied is subjected to a density 
addition process 203 by the control unit. That is, in order 
to reduce the influence of the printed matter P as an in- 
spection target having uneven density due to its warping 
or the like, to a differential image, which will be described 
later, a predetermined density value is added to each of 
the pixels forming the image. The density value to be 
added (hereinafter referred to an additional density val- 
ue) can be property set in the parameter setting, so that 



where the printed matter is likely to have a relatively h igh 
degree of density unevenness, a large density value is 
preferably set. 

[0041 ] The reference value thus prepared is stored in 

5 a reference image memory 204 so as to be utilized in 
detecting dark defects such as stains or spots. 
[0042] On the other hand, a gray scale dilation filter 
205 is also applied by the control unit to the captured 
image, which has been A/D converted at the A/D con- 

10 version unit 201 . Herein, by the gray scale dilation filter 
is meant a process that designates a maximum density 
value in a peripheral region (e.g., a 3 by 3 pixel region 
and a 5 by 5 pixel region) of a target pixel as a new den- 
sity value of the target pixel. The peripheral region and 

is the number of times at which the gray scale dilation filter 
205 is applied can also be set in the parameter setting. 
[0043] Then, the image to which the gray scale dila- 
tion filter 205 has been applied is subjected to a density 
subtraction process 206 by the control unit so that a pre- 

20 determined density value is subtracted from each of the 
pixels forming the image, tn the same manner as the 
density addition process 203, the density value to be 
subtracted can be properly set in the parameter setting 
according to each case, and a large density value is 

25 preferably set where the printed matter is likely to have 
a relatively high degree of density unevenness. 
[0044] The thus prepared reference image is stored 
in a reference image memory 207 so as to be utilized in 
detecting light defects such as printed character defi- 

30 ciencies. Inspection-Ongoing Operation 

[0045] Also, in order to actually inspect each printed 
matter P transferred on the conveyor C, an image (FIG. 
2) of the printed matter captured by the CCD camera 1 
is first converted into digital signals at the A/D conver- 
ts sion unit 201 and stored in an inspection image memory 
208. FIGS. 5(a) and 5(b) respectively illustrate density 
profiles taken along the line A-A (FIG. 2) in the inspec- 
tion image of the printed matter P thus stored in the in- 
spection image memory 208. Specifically, FIG. 5(a) il- 

40 lustrates a density profile of the printed matter P, which 
has a low degree of density unevenness due to a con- 
dition of the printed matter free from warping or the like, 
and FIG. 5(b) illustrates a density profile of the printed 
matter P, which has a high degree of density uneven- 

45 ness ( a P2 n in FIG. 1) due to its warping or the like. 
[0046] then, the inspection image stored in the in- 
spection image memory 208 is subjected to a position- 
ing process 209 by the control unit. That is, since the 
printed matter P transferred on the conveyor C is likely 

so to cause a relatively large positional displacement within 
the imaging field of view of the CCD camera 1 , the po- 
sitioning process 209 is performed in order to correct 
such a positional displacement. A known method can 
be property applied to achieve the positioning process 

55 209. For example, a characteristic portion (e.g., a letter 
n B* in FIG. 3) of the reference image stored in the refer- 
ence image memory 204 or 207 as described above is 
previously determined as a target. Then, a portion, 
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which is identical to the characteristic portion, is extract- 
ed from the inspection image such as by subjecting a 
comparison and normalization process. Then, the in- 
spection image is moved in parallel with the reference 
image so as to match the relative position of the extract- 
ed portion of the reference image to the relative position 
of the characteristic portion of the reference image. Ac- 
cordingly, even if the positioning process 209 is per- 
formed, it is hard to perfectly match the inspection image 
and the reference image to each other due to deforma- 
tion of an image caused in a warped printed matter or 
positioning error. Therefore, as described above, an im- 
age to which the gray scale erosion filter 202 (or gray 
scale dilation filter 205) is applied is designated as a ref- 
erence image, thereby making a subtle positional dis- 
placement of the image acceptable. 
[0047] Then, the inspection image, to which the posi- 
tioning process 209 has been applied, is subjected to a 
differencing process 210 by the control unit relative to 
the reference image stored in the reference image mem- 
ory 204 in order to detect dark defects. Also, the inspec- 
tion image, to which the positioning process 209 has 
been applied, is subjected to a differencing process 211 
by the control unit relative to the reference image stored 
in the reference image memory 207 in order to detect 
light defects. The descriptions will be hereinafter made 
specifically for the process for the detection of dark de- 
fects and the process for the detection of iight defects, 
respectively. 

(1 ). Operation for Detection of Dark Defects 

[0048] First of all, the description will be made for the 
operation for the detection of dark defects. FIGS. 6 re- 
spectively illustrate explanatory views for stepwisely ex- 
plaining an inspection operation for dark defects in the 
printed matter P having a low degree of density uneven- 
ness. The solid line L1 in FIG. 6(a) represents a density 
profile taken along the line A-A of the inspection image 
in FIG. 2, while the broken line L2 represents a density 
profile of the reference image taken along the line B-B 
( FIG. 3) stored in the reference image memory 204. That 
is, the broke line L2 represents a density profile after the 
captured image having a density profile illustrated in 
FIG. 5(c) is applied with the gray scale erosion filter 202 
and then subjected to the density addition process 203 
( u H a represents an additional density value). 
[0049] In the differencing process 210, a differentia! 
image is prepared by subtracting the inspection image 
subjected to the positioning process 209 from the refer- 
ence image stored in the reference image memory 204. 
By subjecting the differencing process 210, or subtract- 
ing the solid line L1 from the broken line 12 in FIG. 6(a), 
a differential image having a density profile as illustrated 
in FIG. 6(b) is prepared. 

[0050] In FIG. 6(b), some pixels are illustrated as be- 
ing negative. In this regard, where the density values fail 
within the range of 0-255, they are clipped at 0 in the 



actual processing. However, it is a matter of course that 
negative values can be treated as density values by in- 
creasing the number of bits in A/D conversion at the A/ 
D conversion unit 201 , or allocating the density values 
5 in the range of -125 to 125 without increase of the 
number of bits. 

[0051] Then, as illustrated in FIG. 4, the differential 
image prepared by the differencing process 210 is sub- 
jected to a density compensation process 212 by the 

io control unit. Herein, by the density compensation proc- 
ess 212 is meant a process that fills a region having a 
negative property (a region having a lower density than 
the density of peripheral pixels) with the density value 
of the peripheral pixels. In this embodiment, the density 

*5 compensation process 212 is achieved by applying the 
gray scale dilation filter and the gray scale erosion filter. 
More specifically, the gray scale dilation filter is repeat- 
edly applied until a region having such a negative prop- 
erty is eliminated. This repeated application of the gray 

20 scale dilation filter causes the enlargement of the size 
of a defect having a positive property. In order to return 
it to a size approximate to the original size, the gray 
scale erosion filter is applied by the number of times 
equal or nearly equal to the number of times the gray 

25 scale dilation filter is applied. The number of times the 
gray scale dilation filter is to be applied in the density 
compensation process 212 depends on the width of an 
edge ( D E1 U in FIG. 6(b)) that depends on the number of 
times the aforesaid gray scale erosion filter 202 has 

30 been applied, accuracy of the density compensation 
process 212 or the like, and therefore the number of 
times, which has been previously and experimentally 
determined, is applied to compensate the density differ- 
ence until at least the edge E1 having a negative prop- 

35 erty is eliminated. FIG. 6(c) illustrates a density profile 
of an image to which the aforesaid density compensa- 
tion process 212 has been applied. This Figure illus- 
trates an example of density compensation , in which not 
only the edge E1 but also a light defect D1 are illustrated 

*o as regions having a negative property, which have been 
density compensated. In this regard, it is to be noted 
that the density of the light defect D1 may not be com- 
pletely compensated, which depends on the size of the 
light defect D1. However, such incomplete compensa- 

45 tion of the density of the iight defect D1 , which makes 
' the iight defect D1 possible to be detected by a binari- 
zation process 214, may not pose a problem in a case 
in which it is enough to only recognize the presence of 
a defect. However, when it is necessary to identify 

so whether a defect is the light defect D1 or the dark defect 
D2, the light defect D1 must be density compensated. 
Accordingly, the number of times the gray scale erosion 
filter is applied in the density compensation process 21 2 
is determined by taking into account the size of a pos- 

55 sible light defect as well. 

[0052] For the printed matter P having a low degree 
of density unevenness, as illustrated in FIG. 7, it is pos- 
sible to achieve the density compensation process 212 
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by applying a density conversion process that converts 
alt the density values lower than a predetermined value 
to a constant density value. A conversion curve illustrat- 
ed in FIG. 7 represents an example where all the density 
values less than the additional density value H are con- 5 
verted to the additional density value H, and therefore 
is not intended to limit the present invention to this ex- 
ample. It is possible to apply a conversion curve with, 
for example, all the density values less than the addi- 
tional density value H converted to 0. 10 
[0053] Then, as illustrated in FIG. 4, the image, to 
which the density compensation process 212 has been 
applied, is subjected to a Sobel filter 213 as an edge 
detection filter by the control unit. Herein, the Sobel filter 
213 involves creating a 3 by 3 pixel operator (FIG. 10 '5 
(a)) for detecting an edge vertically extending in the im- 
age and a 3 by 3 pixel operator (FIG. 1 0(b)) for detecting 
an edge laterally extending in the image, and designat- 
ing the value, which is determined by summing the cal- 
culated results in the respective operators and dividing 20 
the sum by 2, as a new density value, or involves des- 
ignating the square root of the sum of squares of the 
calculated results in the respective operators as a new 
density value. FIG. 6(d) illustrates a density profile of 
the image to which the Sobel filter 21 3 has been applied. 25 
As illustrated in this Figure, the Sobel filter 213 as ap- 
plied makes the dark defect D2 and an outer edge E2 
of the printed mater P prominent, thereby allowing thern^ 
to be securely detected by the binarization process 214, 
which will be later described. This embodiment has 30 
been described by taking for example a case where the 
Sobel filter is applied as the edge detection filter. The 
present invention is not limited to this example. It is pos- 
sible to apply various filters such as Prewitt or Kirsch 
filter, provided that they are capable of detecting an 35 
edge at which a sharp increase or decrease in density 
difference occurs. 

[0054] Then, as illustrated in FIG. 4, the image, to 
which the Sobel filter 21 3 has been applied, is subjected 
to the binarization process 21 4 that converts the image <o 
into binary data according to a predetermined threshold 
value by the control unit. Whereby, the dark defect D2 
and the outer edge E2 are detected. Hereinafter, pixels 
detected by the binarization process will be referred to 
detected pixels. Then, the detected pixels are subjected 
to a masking process 215 by the control unit so as to 
remove the outer edge E2 from the detected pixels, 
thereby extracting only the dark defect D2. In this mask- 
ing process 215, the contour of the printed matter P, 
which has been extracted by an inspection region ex- so 
traction process 216, is utilized as a mask so that only 
the detected pixels present within the mask are extract- 
ed. In the inspection region extraction process 216, the 
inspection image, to which the aforesaid positioning 
process 209 has been applied, is converted into binary 55 
data according to a predetermined threshold value, 
thereby detecting the contour of the printed matter P. 
Then, a binary dilation/binary erosion process is applied 



in order to restore a broken part of the detected contour, 
perform the size adjustment enabling adaptation to a 
subtle positional displacement of the outer edge E2 
caused by the Sobel filter 213. Thus, a mask to be sup- 
plied for the masking process 215 is extracted. 
[0055] Then, the control unit performs a judgment 
process 217 on the basis of the position, size and the 
like of thus extracted dark defect D2, which positions, 
size and the like being respectively compared with pre- 
determined reference values, so as to make a final judg- 
ment as to the quality of each printed matter P. The result 
of the judgment may be informed by means of an alarm, 
an LED or other light emitting means, it is also possible 
to provide a mechanism for discharging the printed mat- 
ter P, which has been judged as a defective printed mat- 
ter, from the conveyor C. 

[0056] The dark defect detection process as de- 
scribed above will be effective also for the printed matter 
having a high degree of density unevenness due to its 
warping or the like. 

[0057] FIGS. 8 respectively illustrate explanatory 
views for stepwisely explaining an inspection process of 
a dark defect in the printed matter P having a high de- 
gree of density unevenness. Specifically, the solid line 
L1 in FIG. 8(a) represents a density profile of the inspec- 
tion image taken along the line A-A in FIG. 2 and the 
broken line L2 represents a density profile of the refer- 
ence image stored in the reference image memory 204, 
taken along the line B-B in FIG. 2. 
[0058] As described above, a differential image hav- 
ing a density profile L11 as illustrated in FIG. 8(b) can 
be prepared by applying the differencing process 210, 
or subtracting the solid line L1 from the broken line L2 
in FIG. 8(a). Also, an image having a density profile as 
illustrated in FIG. 8(c) can be produced by applying the 
density compensation process 212. Herein, assuming 
that the detection of a defect is made by simply applying 
the binarization process to an image having the density 
profile as illustrated in FIG. B(c), it may pose a problem 
of impossibility to detect the dark defect D2 according 
to a threshold Th intended to prevent error detection, 
through which a non-defect region is detected as a de- 
fect region. However, the dark defect detection process 
in this embodiment, which has the Sobel filter 213 ap- 
plied prior to the application of the binarization process 
214, can reduce the influence of uneven density due to 
the positional displacement or warping of the printed 
matter P, and hence performing the binarization process 
in a stabilized condition. In other words, the Sobel filter 
213 is remarkably effective because it enables a se- 
cured inspection even for the printed matter P having a 
high degree of density unevenness. FIG. 8(d) illustrates 
a density prof ile of an image to which the Sobel filter 21 3 
has been applied. As illustrated in this Figure, the Sobel 
filter 213 as applied makes the dark defect D2 and the 
outer edge E2 of the printed matter P prominent, thereby 
allowing them to be securely detected by the binariza- 
tion process 214. 
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(2) Operation for Detection of Light Defects 

[0059] Now, the description will be made for the oper- 
ation for detection of light defects. In this operation, the 
same processes as those for the operation for detection 
of dark defects are applied, except that an inspection 
image, to which the positioning process 209 has been 
applied, is subjected to the differencing process 21 1 by 
the control unit with respect to the reference image 
stored in the reference image memory 207. 
[0060] FIGS. 9 respectively illustrate explanatory 
views for stepwisely explaining an inspection operation 
for light defects of the printed matter P having a high 
degree of density unevenness. Specifically, the solid 
line L1 in FIG. 9(a) represents a density profile of the 
inspection image taken along the line A-A in FIG. 2 and 
the broken line L2 represents a density profile of the ref- 
erence image stored in the reference image memory 
207, taken along the line B-B in FIG. 3. That is, the bro- 
ken line L2 represents a density profile as a result of 
applying the aforesaid gray scale dilation filter 205 and 
then the density subtraction process 206 (TT repre- 
sents a subtracted density value) to a captured image 
having the density profile as illustrated in FIG. 5(c). 
[0061] In the differencing process 211, a differential 
image is prepared by subtracting the reference image 
stored in the reference image memory 207 from the in- 
spection image to which the positioning process 209 has 
been applied. That is, a differential image having the 
density profile L11 as illustrated in FIG. 9(b) is prepared 
by applying the differencing process 211 or subtracting 
the broken line L2 from the solid line L1 in FIG. 9(a). 
[0062] Then, as illustrated in FIG. 4, the differential 
image prepared by the differencing process 211 is sub- 
jected to a density compensation process 21 8 (the same 
process as the density compensation process 212) by 
the control unit. FIG. 9(c) illustrates a density profile of 
an image to which this density compensation process 
218 has been applied. In FIG. 9(c), not only the edge 
E1 but also the dark defect D2 are illustrated as regions 
having a negative property, which have been density 
compensated. In this regard, it is to be noted that the 
density of the dark defect D12 may not be completely 
compensated, which depends on the size of the dark 
defect D2. However, such incomplete compensation of 
the density of the dark defect D2, which makes the dark 
defect D2 to be detected by a binarization process 220 
(later described), may not pose a problem in a case in 
which it is enough to only recognize the presence of a 
defect. However, when it is necessary to identify wheth- 
er a defect is the light defect D1 or the dark defect D2, 
the dark defect D2 must be density compensated. Ac- 
cordingly, the number of times the gray scale erosion 
filter is applied in the density compensation process 218 
is determined by taking into account the size of a pos- 
sible dark defect as well. 

[0063] Then, as illustrated in FIG. 4, the image, to 
which the density compensation process 21 8 has been 



applied, is subjected to a Sobei filter 21 9 (the same filter 
as the Sobel filter 21 3) as an edge detection filter by the 
control unit. FIG. 9(d) illustrates a density profile of an 
image to which this Sobel filter 219 has been applied. 

5 As illustrated in FIG. 9(d), the Sobel filter 21 9 as applied 
makes the light defect D1 and the outer edge E2 of the 
printed mater P prominent, thereby allowing them to be 
securely detected by the binarization process 220. Like- 
wise to the operation for detection of dark defects, this 

10 embodiment has been described by taking for example 
a case where the Sobel filter is applied as the edge de- 
tection filter. The present invention is not limited to this 
example. It is possible to apply various filters, provided 
that they are capable of detecting an edge at which a 
sharp increase or decrease in density difference occurs. 
[0064] Then, as illustrated in FIG. 4, the image, to 
which the Sobel filter 21 9 has been applied, is subjected 
to the binarization process 220 that converts the image 
into binary data according to a predetermined threshold 

20 value, by the control unit. 

[0065] Whereby, the light defect D1 and the outer 
edge E2 are detected. Hereinafter, pixels detected by 
the binarization process will be referred to detected pix- 
els. Then, the detected pixels are subjected to a mask- 

25 ing process 221 by the control unit so as to remove the 
outer edge E2 from the detected pixels, thereby extract- 
ing only the light defect D1 . In this masking process 221 , 
the contour of the printed matter P, which has been ex- 
tracted by the inspection region extraction process 21 6, 

30 is utilized as a mask so that only the detected pixels 
present within the mask are extracted. 
[0066] Then, the control unit performs a judgment 
process 222 on the basis of the position, size and the 
like of thus extracted light defect D1 , which position, size 

35 and the like being respectively compared with predeter- 
mined reference values, so as to make a final judgment 
as to the quality of each printed matter P. The result of 
the judgment may be informed by means of an alarm, 
an LED or other light emitting means. It is also possible 

40 to provide a mechanism for discharging the printed mat- 
ter P, which has been judged as a defective printed mat- 
ter, from the conveyor C. 

[0067] As described above, according to the inspec- 
tion apparatus 100 of this embodiment, it is possible to 

45 detect defects of the printed matters with high accuracy 
by reducing influences of the printed matters which have 
been displaced from the correct or intended position on 
the conveyor or warped printed matters. However, in a 
case where only a light defect or dark defect exists in a 

so specific type of the printed matter P, or performing of 
only the operation for detection of the dark defect or light 
defect does not cause a problem, it is possible to apply 
only either the operation for detection of light defects or 
the operation for detection of dark defects. 

55 [0066] This embodiment has been described by tak- 
ing for example a case where an area scan CCD camera 
is employed as an imaging device. The present inven- 
tion is not limited to this example. It is possible to employ 
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various imaging devices such as a line scan CCD cam- 
era, provided they can capture an image of a surface of 
a printed matter. 

[0069] Also,. this embodiment has been described by 
taking for example a case where printed matters, which 
are transferred on the conveyor, are objects to be in- 
spected. The present invention is not limited to this em- 
bodiment That is, the printed matter P, which is not only 
transferred by the conveyor as described above, but al- 
so by any other transferring members can be an object 
to be inspected. Also, the printed matter, which is in a 
stationary state during the inspection (e.g., a printed 
matter which is manually placed within the imaging field 
of view in a sequential order), can be an object to be 
inspected. That is, in the present invention, the printed 
matters under various conditions and states are accept- 
able as objects to be inspected, as long as they can be 
positioned within the imaging field of view. 
[0070] Also, this embodiment has been described by 
taking for example the case where the gray scale ero- 
sion filter, gray scale dilation filter, differencing process, 
density compensation process and the like are respec- 
tively performed according to the image processing pro- 
gram provided in the image processing device. The 
present invention is not limited to this embodiment. It is 
possible to perform these processes in a hardware-like 
manner such as by an exclusively designed electric cir- 
cuit. 

[0071] This embodiment has been also described by 
taking for example the case where a captured image of 
a non-defect surface of the substrate with printing ap- 
plied thereon is employed as a reference image when 
the printed matter as an inspection object is provided by 
punching or die cutting the substrate. The present in- 
vention is not necessarily limited to this embodiment. 
That is, where printed matters, which are provided not 
by the punching or die cutting but any other process, are 
objects to be inspected, a non-defect printed matter 
among them may be used as a reference image. Even 
if the printed matters are provided by the punching or 
die cutting, it is possible to employ a non-defect printed 
matter among them as a reference image. 
[0072] Thus, according to the inspection method and 
inspection apparatus of the present invention, it is pos- 
sible to achieve the inspection of a defect with high ac- 
curacy by reducing influences of a printed matter, which 
has been displaced from the correct or intended position 
during the conveyance, or warped printed matter. 



Claims 

1. A method of inspecting a defect on a surface of a 
printed matter comprising: 

a step of applying a gray scale erosion filter to 
a non-defect surface of a printed matter to pre- 
pare a gray scale erosion filter applied image 



and then adding a predetermined density value 
to said gray scale erosion filter applied image, 
thereby preparing a reference image; 
a step of subtracting a captured image of the 
5 surface of the printed matter to be inspected 

from said reference image, thereby preparing 
a differential image; and 
a step of applying a density compensation proc- 
ess to said differential Image to prepare a den- 
to sity compensated image, then applying an 
edge detection filter to said density compensat- 
ed image to prepare an edge detection filter ap- 
plied image and then converting said edge de- 
tection filter applied image into binary data ac- 
'5 cording to a predetermined threshold value. 

2. The method of inspecting the defect on the surface 
of the printed matter according to claim 1 , wherein 
said density compensation process is achieved by 

20 applying a gray scale dilation filter and a gray scale 
erosion filter, respectively. 

3. The method of inspecting the defect on the surface 
of the printed matter according to claim 1 , wherein 

25 said density compensation process is achieved by 
applying a density conversion process. 

4. The method of inspecting the defect on the surface 
of the printed matter according to claim 1 , wherein: 

30 

said printed matter is produced by punching or 
die cutting a substrate, on which printing has 
been applied; and 

said reference image is prepared on the basis 
35 of a captured image of a non-defect surface of 

the substrate in a state prior to be punched or 
die cut. 

5. A method of inspecting a defect on a surface of a 
to printed matter comprising: 

a step of applying a gray scale dilation filter to 
a captured image of a non-defect surface of a 
printed matter to prepare a gray scale dilation 
<5 filter applied image and then subtracting a pre- 

determined density value from said gray scale 
dilation filter applied image, thereby preparing 
a reference image; 

a step of subtracting said reference image from 
so a captured image of the surface of the printed 

matter to be inspected, thereby preparing a dif- 
ferential image; and 

a step of applying a density compensation proc- 
ess to said differential image to prepare a den- 
55 sity compensated image, then applying an 

edge detection filter to said density compensat- 
ed image to prepare an edge detection filter ap- 
plied image and then converting said edge de- 
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tection filter applied image into binary data ac- 
cording to a predetermined threshold value. 

6. The method of inspecting the defect on the surface 

of the printed matter according to claim 5, wherein 5 
said density compensation process is achieved by 
applying a gray scale dilation filter and a gray scale 
erosion filter, respectively. 

7. The method of inspecting the defect on the surface 
of the printed matter according to claim 5, wherein 
said density compensation process is achieved by 
applying a density conversion process. 

8. The method of inspecting the defect on the surface 
of the printed matter according to claim 5, wherein: 

said printed matter is produced by punching or 
die cutting a material with printing applied ther- 
eon; and 

said reference image is prepared on the basis, 
of a captured image of a non-defect surface of 
the substrate in a state prior to be punched or 
die cut. 

9. An apparatus for inspecting a defect on a surface 
of a printed matter comprising: 

an imaging device for capturing a surface of a 
printed matter to prepare a captured image; 
and 

an image processing device for applying image 
processing to said captured image of said sur- 
face of said printed matter; wherein said image 
processing device includes: 

a means of applying a gray scale erosion 
filter to a captured image of a non-defect 
surface of a printed matter to prepare a 
gray scale erosion filter applied image; 
a means of preparing a reference image by 
adding a predetermined density value to 
said gray scale erosion filter applied image; 
a means of preparing a differential image 
by subtracting a captured image of a sur- 
face of a printed matter to be inspected 
from said reference image; 
a means of applying a density compensa- 
tion process to said differential image to 
prepare a density compensated image; 
a means of applying an edge detection fil- 
ter to said density compensated image to 
prepare an edge detection filter applied im- 
age; and 

a means of converting said edge detection 
filter applied image into binary data accord- 
ing to a predetermined threshold value. 



10. An apparatus for inspecting a defect on a surface 
of a printed matter comprising: 

an imaging device for capturing a surface of a 
printed matter to prepare a captured image; 
and 

an image processing device for applying image 
processing to said captured image of said sur- 
face of said printed matter; wherein said image 
processing device includes: 



a means of applying a gray scale dilation 
filter to a captured image of a non-defect 
surface of a printed matter to prepare a 
*5 gray scale dilation filter applied image; 

a means of preparing a reference image by 
subtracting a predetermined density value 
from said gray scale dilation filter applied 
image; 

20 a means of preparing a differential image 

by subtracting said reference image from a 
captured image of a surface of a printed 
matter to be inspected; 
a means of applying a density compensa- 
25 tion process to said differential image to 

prepare a density compensated image; 
a means of applying an edge detection fil- 
ter to said density compensated image to 
prepare an edge detection filter applied im- 
30 age; and 

a means of converting said edge detection 
filter applied image into binary data accord- 
ing to a predetermined threshold value. 

35 
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